The Study on Optimal Gait for Five-Legged Robot with Reinforcement Learning
نویسندگان
چکیده
The research of legged robot was rapidly developed. It can be seen from recent ideas about new systems of robot movement that take ideas from nature, called biology inspired. This type of robot begins replacing wheeled robot with various functions and interesting maneuvers ability. However, designers should decide how many legs are required to realize the ideas. One of the ideas that are rarely developed is odd number of legs. This research focused on five legs robot that inspired from starfish. To realize the intelligent system in robot that does not depend on the model, this research used reinforcement learning algorithm to find the optimal gait when robot is walking. In order to achieve this goal, trial and error have been used to provide learning through an interaction between robot and environment based on a policy of reward and punishment. The algorithm is successfully implemented to get the optimal gait on a
منابع مشابه
Free gait generation with reinforcement learning for a six-legged robot
In this paper the problem of free gait generation and adaptability with reinforcement learning are addressed for a six-legged robot. Using the developed free gait generation algorithm the robot maintains to generate stable gaits according to the commanded velocity. The reinforcement learning scheme incorporated into the free gait generation makes the robot choose more stable states and develop ...
متن کاملKinematic and Gait Analysis Implementation of an Experimental Radially Symmetric Six-Legged Walking Robot
As a robot could be stable statically standing on three or more legs, a six legged walking robot can be highly flexible in movements and perform different missions without dealing with serious kinematic and dynamic problems. An experimental six legged walking robot with 18 degrees of freedom is studied and built in this paper. The kinematic and gait analysis formulations are demonstrated by an e...
متن کاملImproved Dynamic Stability Using Reinforcement Learning
Many researchers studying legged locomotion have applied tools from reinforcement learning/optimal control to minimize characteristics of a walking gait, most notably the energy consumption. In this paper, we use similar tools to maximize the region of stability of the controller defined as the set of initial conditions from which the robot maintains its balance for at least 5 seconds. Experime...
متن کاملDynamic Gait Pattern Generation with Reinforcement Learning*
This paper presents the gait pattern generation work performed for the sixlegged robot EA308 developed in our laboratory. The aim is to achieve a dynamically developing gait pattern generation structure using reinforcement learning. For the six legged robot a simplified simulative model is constructed. The algorithm constructs a radial basis function neural network (RBFNN) to command proper leg...
متن کاملReinforcement Learning Methods to Enable Automatic Tuning of Legged Robots
Bio-inspired legged robots have demonstrated the capability to walk and run across a wide variety of terrains, such as those found after a natural disaster. However, the survival of victims of natural disasters depends on the speed at which these robots can travel. This paper describes the need for adaptive gait tuning on an eight-legged robot, which will enable it to adjust its gait parameters...
متن کامل